Depth from Defocus for Misaligned Mobile Photos Subject to Parallax Effects

This paper describes and implements an attempt to solve the problem of determining depth from defocus when given a focal stack (set of photos taken at different focuses) created from photos captured with a hand-held camera with unknown calibration. Although the photos may initially suffer from significant parallax due to camera/hand movement during capture, the image alignment steps explained in Section III are shown to be capable of compensating for such issues. Relative depth results are computed quickly, though suffer from some shortcomings around depth edges as discussed in Section VII. The final computed depth map is also shown to be sufficient for rendering visually pleasing synthetically refocused photos of the scene.